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Abstract. So far, various techniques have been implemented for generating dis¬ 
crete distributions based on continuous distributions. The characteristics and 
properties of this kind of probability distributions have been studied. Further¬ 
more, the estimation of related parameters have been computed trough classical 
methods. However, a few studies addressed the parameter estimate issue of these 
distributions through Bayesian methods. This is essentially because of the com¬ 
plexity of the model whatever the number of parameter is and the fact that in 
general they contain a large number of parameters to be estimated. This paper 
deals with computing Bayes estimate of the parameters of discrete Burr distri¬ 
bution with two parameters. Since the resulting posterior distribution of the 
parameters is not standard, we apply Metropolis-Hastings algorithm to simulate 
from the posterior density. 
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1 Introduction 

In statistics and probability theory, a discrete probability distribution is a distri¬ 
bution characterized by a probability mass function. The discrete random vari¬ 
ables have attracted the attention of many researchers due to their applications 
in many fields. One of them is their great importance to model real-life scenar¬ 
ios. Also, much of the information bioinformatics deals with is discrete data and 
sequence information is usually analyzed using discrete random variables. 

In reliability lifetime modeling, it is common to treat failure data as being 
continuous, implying some degree of precision in measurement. Too often in 
practice, however, failures are either noted at regular inspection intervals, occur 
in a discrete process or are simply recorded in bins. An important aspect of 
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lifetime analysis is to find a lifetime distribution that can adequately describe 
the aging behavior of the device concerned. Howevere, it is sometimes impossi¬ 
ble or inconvenient to measure the life length of a device on a continuous scale. 
Thus, it is essential to construct a discrete lifetime models for discrete failure 
time models. Various methods of constructing discrete lifetime models have been 
developed by discretizations of continuous lifetime models, in particular, through 
discretizations of their hazard rates. Using these techniques, continuous distri¬ 
butions can be transformed to discrete distributions. Katz [3] , Roknabadi et al. 
[5], Krishna and Pundir [T] have expressed different methods to generate discrete 
families of distributions. Burr distribution with two parameters is obtained using 
the general approach of discretizing continuous distribution which can be consid¬ 
ered as suitable lifetime models. In this work, we are interested in the parameter 
estimation issue for the Burr distribution. From a classical point of view, the 
parameters are supposed to be fixed and the classical estimation methods such 
as Maximum Likelihood and Moment Method [6] can be used. On the other hand 
from the Bayesian perspective, the parameters of the model of interest are ran¬ 
dom variables. In this case, Bayesian methods are applied in order to estimate the 
parameters. After specifying the prior distribution for the parameters, since the 
resulting posterior distribution is non-standard, Metropolis-Hastings algorithm 
is applied in order to simulate from the posterior distribution. The results of im¬ 
plementing the Metropolis-Hastings algorithm are summarized by averaging over 
the draws in the case of supposing a squared loss function and it is considered as 
the approximations of the parameter estimators. We proceed here with a briefly 
review of some distributional properties of Burr distribution. 

A continuous lifetime random variable X follows the Burr-XII distribution Br(Q;, 
/3) if its probability density function is as follows: 

f(x) = — - TflTT) X > 0,a,B > 0 

For every x > 0, the survival function S{x) and the failure rate r(x), that is 
defined as the ratio of the probability density to the failure rate, are respectively 
given by 

S{x) = (l+x»)-'’; = 

1 -|- 

The Second rate of failure is also given by 

r*{x) = log[S{x)/S{x -F 1)] = -/3log[ _^ 
and the r’s moment is 


E{X'^) = (3B{ra ^ + l,fi — ra ^), a,/3 > 0, a/3 > r > 0 
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where B{a,b) = — x)^~^dx. In a particular case where a = 1, we get 

Pareto distribution Par{f5) 0 with its own reliability characteristics. If times are 
grouped into unit intervals, the discrete observed variable is dX = [X] which 
is considered as the largest integer less than or equal to X. It will have the 
probability function as following: 

P{dX = x)= p{x) = P{x < X < X + 1) = S{x) - S{x + 1) (1) 

where x = 0,1, 2,... . Krishna and Pundir [T] applied this method to study the 
discrete Pareto and discrete Burr distributions. Using equation we can define 
the probability mass function of discrete Burr distribution, namely DBD{a,9) 
H, as following: 


p{x) = _ 0 log{l+il+xr} ^ X = 0, 1, 2, ... 

Note that the failure rate value S{x) is the same for both Br(a, /?) and DBD[a, 9) 
in the cases where the variable x takes the integer values. The next section fo¬ 
cuses on the Bayesian estimation of the parameters of DBD, a and 9. 


2 Bayesian estimation of parameters 

Suppose that Xi, ..,Xn are from a discrete Burr distribution with parameters a 
and 9, then 

PaA^) = = 0,1,...,0 < 0 < l,a > 0 (2) 

which is equivalent to 

P0(x)(xnti(r*i-r-) (3) 

where wn = log{l + Xi“) and Wi 2 = log[l + (1 + x^)"]. We consider two following 
cases. 

2.1 a or 6* is unknown 

When a is known, because 9 belongs to the unit interval, a natural prior distri¬ 
bution choice can be a beta distribution with hyperparameters a and 1 that is 
written as 

7r{9) oc 0““^ 


^continuous Pareto distribution with parameter /3 
^discrete Burr distribution with parameters a and 6 


( 4 ) 
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The posterior distribution of 9 is therefore obtained as follows: 

7r{e\x) oc 

oc - 6 '“' 0 ] 


(5) 


By considering Wi = Wi 2 — wn, we will have 


7r(0|x) 



-1 


( 6 ) 


By assuming a squared-error loss function the Bayesian estimation of the param¬ 
eter 9 can easily be obtained as: 


9* = 


nr=i( 


Wi 


nr=i(^) 


(7) 


where Aj = rca + ^ +1, Pi = f +1, = w'a + +1 and Ti = Wi 2 + ^ + 1. 

While only a is assumed to be unknown we consider the case where there is no a 
priori information about the distribution of a. We therefore define the following 
prior density for a: 

^ " ( 8 ) 


7r(Q;) oc —, a > 0 
a 

The posterior distribution obtained by combining the likelihood with the prior 
distribution will be 


7r(a|x) oc - 0"’*)] 

a 


(9) 


which implies that 


TT{a\x) = - 9^*)] (10) 

a 

where Z{9)~^ is the unconditional marginal distribution of the random variable 
X and is calculated as follows: 

poo -j 

Z-\9)= (11) 

Jo « 

Since the posterior density obtained in (fTOt) is not standard, we use the numerical 
methods by programing in R software. A simulation study involves three sample 
of size 25 that are simulated from the discrete Burr distribution when the true 
values of 9 and a are 0.1, 0.2,0.3 and 1,2,3, respectively. We implement the 
Metropolis-Bastings algorithm [2] by considering a gamma distribution as the 
default proposal distribution for the parameter a. Tables [U and [2] show the 
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Table 1: Simulation results when the loss function is squared error. 


e 1 

a=l 

0=2 

0=3 

q ;=4 

0.1 

a 

var(a) 

1.2120 

0.0829 

1.9623 

0.2222 

2.8210 

0.5887 

3.9420 

0.6661 

0.2 

d 

var(d) 

1.0285 

0.1609 

2.0540 

0.4266 

3.0560 

1.1023 

3.9910 

1.2491 

0.3 

d 

var{d) 

1.0747 

0.2546 

2.0355 

0.6886 

3.0020 

1.7974 

4.0100 

1.9379 


Table 2: Simulation results when the loss function is absolute error. 


ei 


0=2 

0=3 

q =4 

0.1 

d 

var(d) 

1.1900 

0.0829 

1.9096 

0.2222 

2.7200 

0.5887 

2.8180 

0.6661 

0.2 

d 

var{d) 

1.5926 

0.1609 

2.5727 

0.4266 

3.7270 

1.1023 

3.8140 

1.2491 

0.3 

d 

var{d) 

2.0294 

0.2546 

3.2620 

0.6886 

4.7120 

1.7974 

4.7900 

1.9379 


summary statistics of 10^ MCMC iterations based on squared and absolute error 
loss functions. By comparing the trne values of a noted in the hrst row of the 
tables with the resulting estimations, Tables [T] and [2] illustrate the accuracy of 
the method to compute the posterior estimates of a in this case. 


2.2 a and 6 are both unknown 

Joint prior density of a and 0 can be as following 

7r(a, e) oc 0 < 6» < 1, a > 0 (12) 

a 

which results in the following joint posterior distribution 


7r(Q;, 6 \x) 



a OiTi 


a 


(13) 


where Wi = - wn, 5i = wn + ^ + I and n = ^ + 1. 

In order to simnlate from the posterior distribntion above we apply the Metropolis- 
Bastings algorithm when the candidate proposals of a and 6 are simnlated from a 
uniform U(0,1) and a gamma distributions centered on the maximnm likelihood 
estimate of 9, respectively. By running the algorithm with 10^ MCMC iterations 
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Table 3: Simulation results when the loss function is squared error. 


e i 

a=l 

a=2 

a=3 

a=4 

0.1 Q 

§ 

var{a) 
var{a) 
var{6) 
corr(d, 9) 

1.1002 

0.0812 

0.5784 

0.5784 

0.0069 

0.2046 

I. 9120 

0.0965 

II. 7378 
11.7378 

0.0114 

0.3094 

2.920 

0.1592 

36.1284 

36.1284 

0.0059 

0.3242 

3.644 

0.1379 

55.2465 

55.2465 

0.0029 

0.2523 

0.2 d 

9 

var{a) 
var{9) 
corr{a,9) 

1.1918 

0.1915 

0.5880 

0.0102 

0.0557 

2.4980 

0.1742 

14.1243 

0.0071 

0.2473 

2.7800 

0.2180 

13.2204 

0.0039 

0.1675 

3.9300 

0.1728 

32.2304 

0.0019 

0.1735 

0.3 d 

9 

var{a) 
var{9) 
corr(d,9) 

1.6080 

0.2701 

2.2266 

0.0083 

0.1066 

2.1800 

0.2564 

18.6511 

0.0028 

0.1883 

3.5700 

0.3121 

32.4364 

0.0027 

0.2394 

3.7600 

0.3422 

33.6526 

0.0034 

0.2615 


for three datasets described in the previous section, the posterior estimations of 
the parameters are summarized in Tables [3] and [H Once again, both parameters 
a and 9 are accurately estimated while the variance of the posterior estimates 
are at least 0.08. 


3 Conclusion 

This paper deals with computing Bayesian estimation of the parameters of dis¬ 
crete Burr distribution with two parameters by applying the Metropolis-Bastings 
algorithm. Simulated datasets have been used in order to compute the parameter 
estimates based on two loss functions, squared-error and absolute-error. While 
the posterior distribution of the parameters is non-standard, the MCMC results 
illustrate that this method is satisfactory to estimate the unknown parameters of 
the discrete Burr distribution. 
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Table 4; Simulation results when the loss function is absolute error. 


ei 

OL=l 

a=2 

0=3 

Q;=4 

0.1 d 

e 

var{di) 
var(6) 
corr“(d, 6) 

1.0970 

0.0817 

0.5784 

0.0069 

0.2046 

I. 8170 

0.1022 

II. 7378 

0.0114 

0.3094 

3.1910 

0.0703 

36.1284 

0.0059 

0.3242 

3.9790 

0.1451 

55.2465 

0.0029 

0.2523 

0.2 d 

e 

far(d) 
var{6) 
corr^a^ 9) 

1.0560 

0.2918 

0.5880 

0.0102 

0.0557 

1.8940 

0.2563 

14.1243 

0.0071 

0.2473 

2.6600 

0.1966 

13.2204 

0.0039 

0.1675 

4.000 

0.1810 

32.2304 

0.0019 

0.1735 

0.3 d 

9 

var{di) 
var(9) 
corr^a.^ 9) 

1.2630 

0.3068 

2.2266 

0.0083 

0.1066 

1.8600 

0.2681 

18.6511 

0.0028 

0.1883 

3.3100 

0.2725 

32.4364 

0.0027 

0.2394 

3.6600 

0.3207 

33.6526 

0.0034 

0.2615 
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